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Feedback controlled ratchets are thermal rectifiers that use information on the state of the system 
to operate. We study the effects of time delays in the feedback for a protocol that performs an 
instantaneous maximization of the center-of-mass velocity in the many particle case. For small 
delays the center-of-mass velocity decreases for increasing delays (although not as fast as in the few 
particle case). Ifowever, for large delays we find the surprising result that the presence of a delay 
can improve the fiux performance of the ratchet. In fact, the maximum fiux obtained with the 
optimal periodic protocol is attained. This implies that the delayed feedback protocol considered 
can perform better than its non-delayed counterpart. The improvement of the fiux observed in the 
presence of large delays is the result of the emergence of a new dynamical regime where the presence 
of the delayed feedback stabilizes quasiperiodic solutions that resemble the solutions obtained in a 
certain closed-loop protocol with thresholds. In addition, in this new regime the system presents 
multistability, i.e. several quasiperiodic solutions can be stable for a fixed time delay. 

PACS numbers: 05.40.-a, 02.30.Yy 



I. INTRODUCTION 

Brownian motors or ratchets are mechanisms that in- 
duce transport rectifying the motion of Brownian parti- 
cles through the introduction of a time-dependentpertur- 
bation that drives the system out of equilibrium [l| . This 
type of systems allow to get insight in non-equilibrium 
processes [Ij . In addition, they are also important due to 
their applications to many fields as nanotechnology and 
biology li. 

The two main types of ratchets are rocking ratch- 
ets [1, Q and flashing ratchets [1, Q ■ In rocking ratch- 
ets (also called tilting ratchets) the perturbation acts as 
a time-dependent additive driving force, which is un- 
biased on the average, while in flashing ratchets (also 
called pulsating ratchets) the time-dependent perturba- 
tion changes the potential shape without affecting its spa- 
tial periodicity. An example of a flashing ratchets is a 
ratchet that operates switching on and off a spatially pe- 
riodic asymmetric potential. In this particular case it can 
be seen that a simple periodic or random switching can 
rectify thermal fluctuations and produce a net current of 
particles. 

A new class of ratchets that use information on the 
state of the system to operate have been introduced in 
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Ref. [6| . These feedback ratchets (or closed- loop ratchets) 
are able to increase the net current and the power output 
of collective Brownian ratchets [1, 0, H, Hi ■ Feedback can 
be implemented monito ring the positions of the particles 
(see for example Refs. [UllH) and subsequently using 
the information gathered to decide whether to switch on 
or off the ratchet potential according to a given protocol. 
In addition, feedback ratchets have been recently sug- 
gested as a mechanism to explain the stepping motion of 
the two-headed kinesin 12). 

The first feedback protocol proposed was the so-called 
instantaneous maximization of the center-of-mass veloc- 
ity [3], which switches on the potential only if switching 
on would imply a positive displacement for the center- 
of-mass position (i.e., if the net force with the potential 
on would be positive). The instantaneous maximization 
protocol gives the maximum current in the case of one 
particle and performs better than any open-loop protocol 
for few particles. However, it has a very low performance 
in the many particle case given an average center-of-mass 
velocity smaller than that obtained with an optimal peri- 
odic protocol. (We call many particle case the case when 
the fluctuations of the net force are smaller than its max- 
imum absolute value.) An improvement of the instanta- 
neous maximization protocol is the threshold protocol 0] , 
which consist on introducing two threshold values in or- 
der to switch the potential before the net force reaches a 
zero value. In this way, there is an increase of the perfor- 
mance for many particles up to velocity values equaling 
the ones of the optimal open-loop periodic protocol. 
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In order to check if it is experimentally feasible to ob- 
tain the increase of performance theoretically predicted 
for the few particle case one important question is to 
check the effects of time delays in the feedback that would 
be present in any experimental implementation. These 
time delays in the feedback come from the fact that the 
measure, transmission, processing, and action steps take 
a finite time interval [13, 14] • Time delays in the feed- 
back also appear naturally in complex systems with self 
regulating mechanisms [l^, [lB| • Recently, we have inves- 
tigated the effects that the delay has in the operation of 
feedback controlled ratchets in the few particle case [l3| • 
We have found that even in the presence of time delays 
feedback controlled ratchets can give better performance 
than the corresponding optimal open- loop ratchet, al- 
though time delays decrease the performance. 

In this paper we investigate the effects of time delays 
in the instant maximization protocol for the many par- 
ticle case. We find that for small delays the asymptotic 
average center-of-mass velocity decreases for increasing 
delays (although not as fast as in the few particle case). 
However, if we continue increasing the time delay the av- 
erage velocity starts to increase up to the value obtained 
for an optimal open-loop protocol. This surprising result 
makes that for many particles the instant maximization 
protocol gives greater average velocities in the presence 
of delay than in its absence. In Sec. |TT] we present the 
evolution equations of the system. In the next section, 
Sec. IIII[ we briefly review the results for zero delays that 
will be useful, and thereafter we expose the results in the 
two dynamical regimes: small delays and large delays. 
Finally, in Sec. llVl we summarize and discuss the results. 



II. THE MODEL 

The feedback ratchet we consider consists of N Brow- 
nian particles at temperature T in a periodic poten- 
tial V{x). The force acting on the particles is F{x) = 
—V'{x), where the prime denotes spatial derivative. The 
state of this system is described by the positions Xi {t) of 
the particles satisfying the overdamped Langevin equa- 
tions 

-fxdt) = a{t)F{x,{t)) + ^^{ty, z = l,...,iV, (1) 

where 7 is the friction coefficient (related to the diffusion 
coefficient D through Einstein's relation D = ksT/j) 
and £,i{t) are Gaussian white noises of zero mean and 
variance {^i{t)^j{t')) = 2-fkBTSijd{t - t'). The control 
policy uses the sign of the net force per particle. 
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as follows: The controller measures the sign of the net 
force and, after a time r, switches the potential on {a = 
1) if the net force was positive or switches the potential 





FIG. 1: Panel (a): 'Smooth' potential (g]) for 
Vo = bksT. Panel (b): 'Saw-tooth' potential ^ for 
Vo = 5kBT and a = 1/3. Units: L = 1, ksT = 1. 



off {a = 0) if the net force was negative. Therefore, the 
delayed control protocol considered is 



a(t) = e(/(t-r)). 



(3) 



with @ the Heaviside function [8(2:) = 1 if x > 0, else 
e(x) = 0]. 

As ratchet potential we consider the 'smooth' potential 
of period L and height Vq (Fig.[T]a), 
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We have also verified that analogous results are obtained 
for the 'saw-tooth' potential of period L, i.e. V{x) = 
V{x + L), height Vq, and asymmetry parameter a < 1/2 
(Fig.fflb), 
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if < f < a, 
if a < f < 1. 



(5) 



The height Vo of the potential is the potential differ- 
ence between the potential at the minimum and at the 
maximum, while aL is the distance between the mini- 
mum and the maximum positions. In view of this defini- 
tion, the 'smooth' potential ^ has asymmetry parame- 
ter a = 1/3. 

Throughout the rest of this paper, we will use units 
where L = 1, ksT = 1, and D = 1. 

We consider in this paper the many particles case that 
is characterized by the fact that the typical fluctuations 
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FIG. 2: Center-of-mass velocity as a function of the 

delay (for large delays only the first branch is 
represented here), and comparison with the results 
obtained with the threshold protocol and with the large 
delay approximation Eq. For the 'smooth' 

potential ^ with Vq = Sfc^T and N = 10^ particles. 
Units: L = 1, D = 1, ksT = 1. 



mass velocity can be computed as 



^on ^" ^off 



with 



Ax(ion) = Aa;on[l 



,-to„/(2At„„)i 



(6) 



(7) 



where Axon and Afon are obtained fitting the displace- 
ment during the 'on' evolution for an infinite number of 
particles (see Ref. [1] for details). 

On the other hand, for many particles the fluctuations 
of the net force are smaller than the maximum value of 
the net force. This allows the decomposition of the dy- 
namics as the dynamics for an infinite number of particles 
plus the effects of the fluctuations due to the finite value 
of N. The late time behavior of the net force /(i) for 
an infinite number of particles is given for the on and off 
dynamics by @ , 



/^°°(t) = C^e-^'^(*-^") with ly = 



off. 



(8) 



of the net force are smaller than the maximum values of 
its absolute value. 



III. DELAYED MANY PARTICLE FEEDBACK 
RATCHET 

We study the effects of time delays in the previous 
feedback controlled Brownian ratchets in the many par- 
ticles case, considering both the 'smooth' potential and 
the 'saw-tooth' potential for various potential heights and 
different initial conditions. 

We find that the system presents two regimes sepa- 
rated by a delay Tmin for which the center-of-mass ve- 
locity has a minimum; see Fig. [21 In the small delay 
regime (t < Tmin) the flux decreases with increasing de- 
lays as one could expect. On the contrary, in the large 
delay regime (r > Tmin) we have observed and explained 
a surprising effect, namely, the center-of-mass velocity 
increases for increasing delays and the system presents 
several stable solutions. We have found that this critical 
time delay r„iin is inversely proportional to the potential 
height Tmin oc 1/Vq with a proportionality constant that 
mildly depends on the number of particles. 



A. Zero delay 

The many particle ratchet in absence of delay (i.e^^r — 
in the model of Sec.|TT| have been studied in Ref. Q. It 
has been shown that the net force per particle exhibits a 
quasideterministic behavior that alternates large periods 
of time ton with f{t)>0 (on dynamics) and large periods 
of time toff with f{t)<0 (off dynamics). The center-of- 



The coefficients C^, A^, and can be obtained fitting 
this expression with the results obtained integrating a 
mean field Fokker-Planck equation obtained in the limit 
N ^ oo and without delay; see Refs. [g', ^ for details. 
For a finite number of particles the fiuctuations in the 
force induce switches of the potential and the times on 
and off are computed equating to the amplitude of 
the force fluctuations, resulting [6] 

ton+toff = b + d\nN, (9) 

with b = Con + Coff and d = (Aon + Aoff)/(2AonAoff). 



B. Small delays 

For small delays, r < Tmin, we observe that the flux 
decreases with the delay. See Fig. [2j We have seen that 
this decrease is slower than that found for the few particle 
case [l3|, and that the expressions derived to describe 
this decrease in the few particles case does not hold here. 
However, the decrease observed here can be understood 
by the fact that the delay implies an increase of the time 
interval between switches, which makes the tails of /(t) 
longer than for no delay and the form of f(t) less smooth 
than for no delay. See Fig. [3l The main effect of the delay 
is to stretch the 'on' and 'off' times of the dynamics; then, 
using the many particle approximation Q we can write 

;• \ _ AXon _ Aa;on 

^""'""^ " ion + toff + At " 6 + dlniV + Ar' ^'^^ 

where we have found that the increase of the length of 
the on-off cycle At is proportional to the delay At cx t. 
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FIG. 3: Evolution of the net force with a small delay 
(r = 0.02) for the 'smooth' potential Eq. dH) with 
Vo = SfcijT and N = 10^ particles. Units: L^l, D = l, 
ksT = 1. 



FIG. 5: First three branches of stable solutions for the 
'smooth' potential (g]) with Vq = bksT and N = 10^ 
particles. Units: L = 1, D = 1, kgT — 1. 
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FIG. 4: Evolution of the net force with a large delay 
(r = 0.12) for the 'smooth' potential Eq. ([4|) with 
Vo = bksT and N = 10^ particles. Units: L = 1, D ^ 1, 

kBT=l. 



C. Large delays 

After the minimum flux is reached for r = Tmin, the 
flux begins to increase with the time delay (see Fig. ^ . 
This increase is due to a change in the dynamical regime: 
for r > Tmin the present net force starts to be nearly 
synchronized with the net force a time r ago. This self- 
synchronization gives rise to a quasiperiodic solution of 
period T = t. Note that there is not a strict periodicity 
due to stochastic fluctuations in the 'on' and 'off' times. 
Looking at the f{t) dependence, Fig. 21 we see that the 
solutions stabilized by the selfsynchronization are simi- 
lar to those obtained with the threshold protocol 0, [1] ■ 
In Fig. [2] we show that the threshold protocol that has 
the same period gives similar center-of-mass velocity val- 
ues, conflrming the picture. (Differences are due to the 
fact that we have considered for the threshold protocol 



simulations with on and off thresholds of the same mag- 
nitude, while Fig. 2] shows that the effective thresholds 
are different.) 

This picture allows to understand the increase of ve- 
locity for increasing delay, and the presence of a maxi- 
mum. This maximum is related with the optimal values 
of the thresholds that have been shown in Q to give a 
quasiperiodic solution of period 7^n + T^ff , with 7^n and 
T^ff the optimal 'on' and 'off' times of the periodic pro- 
tocol. Therefore, if we know the values of 7^n and T^ff 
for the optimal periodic protocol [T^n ~ (1 — a)^/Vb and 
Tos ~ '1^/2] we can predict that the maximum of the 
center-of-mass velocity is reached for a delay 

T'max = "Ton + ^ff, (H) 

and has a value 

(■^cm)closcd('^inax) — (*^cin)open' (-^2) 

with (icm)J?Jfon the center-of-mass velocity for the opti- 
mal open-loop protocol. Thus, this expression gives the 
position and height of the maximum of the delayed feed- 
back control protocol in terms of the characteristic values 
of the optimal open-loop control. In particular, it implies 
that the position and height of the maximum for the flux 
is independent of the number of particles. 

As an example we can apply these expressions to the 
'smooth' potential with Vo = 5 that for the optimal pe- 
riodic protocol gives (icm) = 0.44 for Ton = 0.06 and 
Toff = 0.05, so we obtain T,nax = 0.06 + 0.05 = 0.11 in 
agreement with Fig. [21 

For values of the delay of the order of or larger than 
Tmax quasiperiodic solutions of other periods start to be 
stable; see Fig. |5l The periods for the net force f{t) that 
are found are those that flt an integer number of periods 
inside a time interval r, verifying that the present net 
force is synchronized with the net force a time r ago, 
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that is, the quasiperiodic solutions have periods T = r/2, 
T = t/3, . . . In addition, it can be seen that the center- 



of-mass velocity of the n branch 



period T ■ 
through 



It /n 



whose /(t) has 



r/n is related with that of the T = t branch 



{Xcm)T/n{T) = {x cm) t (t / u) . 



(13) 



We highlight that several branches can be stable for the 
same time delay r. Whether the system finally goes to 
one or another stable solution depends on the initial con- 
ditions and on the particular realization of the noise. See 
Fig. m For these branches we have found initial con- 
ditions that goes to these solutions and that remain in 
them during several thousands of periods, indicating that 
they are stable solutions or at least metastable solutions 
with a large lifetime. 

The analogy with the threshold protocol allows to use 
the analytic results of [1| to get further insight in the 
numerical results. The behavior for large delays for the 
T = T branch can be obtained using the relation 



(14) 



with Ax{t) given by Eq. ([7|). This equation gives a good 
prediction for the largest delays of the first branch (see 
Fig. [21). 

On the other hand, for very large values of the delays 
of the first branch the solutions in a given branch start 
to become unstable, what can be understood noting that 
this happens when the fluctuations of the net force be- 
come of the order of the absolute value of the net force. 
Thus, the maximum delay that gives a stable solution in 
the first branch is 



arise. Although in the many particle case without delay 
the instantaneous maximization protocol performs worst 
than the optimal open-loop protocol, the introduction of 
a delay can increase the center-of-mass velocity up to the 
values given by the optimal open-loop control protocol. 

For small delays the asymptotic average velocity de- 
creases for increasing delays, until it reaches a minimum. 
After this minimum, a change of regime happens and the 
system enters a selfsynchronized dynamics with the net 
force at present highly correlated with the delayed value 
of the net force used by the controller. This selfsynchro- 
nization stabilizes several of the quasiperiodic solutions 
that can fit an integer number of periods in a time inter- 
val of the length of the time delay. The stable quasiperi- 
odic solutions have an structure similar to those solutions 
appearing in the threshold protocol. This analogy has 
allowed us to make numerical and analytical predictions 
using the previous results for the threshold protocol 
In particular, we have established the location and value 
of the maximum, and also the value of the time delay 
beyond which a quasiperiodic solution becomes unsta- 
ble. The results obtained shown that for most time de- 
lays several solutions are stable and therefore the systems 
presents multistability; which stable solution is reached 
depends on the past history of the system. 

The possibility to choose the quasiperiod of the solu- 
tion we want to stabilize just tuning the time delay can 
have potential applications to easily control the particle 
flux. Note that we can even leave some branch just going 
to time delays where the branch is already unstable, and 
force the system to change to another branch of solutions. 



Tinst = ton + toS = b + dlnN, 



(15) 



where b and d are determined as in Eq. ([5]). For example, 
for the 'smooth' potential with Vq = 5, which has b — 
-0.070 and d = 0.031, we obtain for N = 10^ particles 
the value Tjnst = 0.29 in accordance with the numerical 
results shown in Figs. [2] and [S] 

The previous results for the first branch, Eqs. and 
(fTS)) . can be extended to other branches by direct appli- 
cation of the relation (11311. 



IV. CONCLUSIONS 

We have studied the effects of time delays in the many 
particle case, where surprising and interesting results 
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